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ABSTRACT 


Abstract 


he recent wave of test-based accountability reforms 

has negatively impacted the provision of K-12 arts 
educational experiences. Advocates contend that, in addi- 
tion to providing intrinsic benefits, the arts can positively 
influence academic and social development. However, the 
empirical evidence to support such claims is limited. We 
conducted a randomized controlled trial with 10,548 3rd- 
8th grade students who were enrolled in 42 schools that 
were assigned by lottery to receive substantial influxes of 
arts education experiences provided through school-com- 
munity partnerships with local arts organizations, cul- 
tural institutions, and teaching-artists. We find that these 
increases in arts educational experiences significantly 
reduce the proportion of students receiving disciplinary 
infractions by 3.6 percentage points, improve STAAR 
writing achievement by 0.13 of a standard deviation, and 
increase students’ compassion for others by 0.08 of a stan- 
dard deviation. For students in elementary schools, which 
comprise 86 percent of the sample, we find that these arts 
educational experiences also significantly improve school 
engagement, college aspirations, and arts-facilitated 
empathy. These findings provide strong evidence that arts 
educational experiences can produce significant positive 
impacts on student academic and social development. 
Policymakers should consider these multifaceted educa- 
tional benefits when assessing the role and value of the 
arts in K-12 schools. 
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INTRODUCTION 


Introduction 


| Falenstis a steady increase throughout most of the 20th century, arts education 


opportunities in the United States have been in steady decline since the 1980s 
(Hamilton et al., 2007; Rabkin & Hedberg, 2011; von Zastrow & Janc, 2004; West, 
2007). This trend has not been equitable across student subgroups. Over this 


period, white students have experienced virtually no change, whereas African- 


American students have experienced reductions of 49 percent and Hispanic/ 


Latinx students by 40 percent. Moreover, children whose parents have less than a 


high school education have experienced a 77 percent decline (Rabkin & Hedberg, 


2011). Childhood arts experiences predict arts participation and engagement later 


in life, meaning that decreases in childhood access likely has lasting effects. These 


trends are especially concerning in Houston, where 86% of students enrolled in the 


Houston Independent School District (HISD) are African-American or Hispanic/ 
Latinx (HISD, 2017). Moreover, in the 2012 Houston Arts Survey, it was reported 
that nearly 60% of respondents had attended at least one artistic performance 


in the past year; however, participation plummeted to 29% for individuals from 
households with incomes at or below $37,500 (Klineberg, Wu, & Aldape, 2012). 


The arts have intrinsic benefits for participants, but advo- 


cates also contend that the arts play a vital role in public 
education because they enhance skills and knowledge 
that transfer to student performance in other academic 
subjects, positively affect social and emotional learning, 


and enhance artistic ability and creativity which are valu- 


able skills in today’s economy. (Deasy, 2002; Eisner, 2002; 
Winner, Goldstein, & Vincent-Lancrin, 2013; Winner & 
Hetland, 2001). However, the arts remain a prime target 
for cuts when education administrators and policymak- 
ers face accountability-driven tradeoffs (Yee, 2014). Since 
the passing of the No Child Left Behind Act (2001), the 
emphasis on standardized testing in “core subjects” has 


coincided with notable declines in school-facilitated arts 
exposure (Gadsden, 2008). There is a strong link between 
the emphasis on accountability testing and decreases 

in time and resources for the arts and other non-tested 
subjects (Bassok, Latham, & Rorem, 2016; Government 
Accountability Office, 2009; Guzenhauser, 2003; West, 
2007). Moreover, evaluations of education programs and 
policies increasingly rely on empirical evidence, yet the 
causal benefits of the arts have rarely been rigorously 
investigated with experimental methods (Winner & 
Cooper, 2000; Winner, Goldstein, & Vincent-Lancrin, 
2013; Winner & Hetland, 2001). Asa result, policymakers 
and administrators struggle to make the case for the arts 
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in K-12 schools, and advocates lack evidence to quantify 
the costs that come with decreases in access. 


An increasingly common strategy for addressing K-12 arts 
educational inequities is the formation of school-com- 
munity arts partnerships. Typically, these partnerships 
consist of school- and district-level administrators, cul- 
tural institutions, philanthropists, government officials, 
researchers, and a “backbone” organization that facili- 
tates these collaborations (Bowen & Kisida, 2017; Perille, 
2016). Successful partnerships have flourished in many 
urban school districts, including Boston, Chicago, Los 
Angeles, and Seattle. One such partnership, Houston’s 
Arts Access Initiative (AAJ), launched in 2013. This 
multi-sector, collaborative effort aimed to advance student 
access to the arts through “strategy, partnerships, data 
collection, and advocacy.” The AAI vision statement was 
“that every student in Houston will have the opportunity 
to benefit cognitively, creatively, emotionally, and academ- 
ically through the arts,” with an emphasis on foundation- 
al goals of equity, impact, and sustainability. As with arts 
education research in general, only a few studies have 
investigated the effects of these partnerships (Catterall & 
Waldorf, 1999; Rowe, Werber, Kaganoff, & Robyn, 2004). 
Preliminary research suggests that school-community 
arts partnerships improve academic achievement and at- 
tainment (Catterall & Waldorf, 1999); however, there is no 
causal evidence about the impacts of these interventions. 


After conducting a district-wide campus inventory, AAI 
stakeholders developed strategies to serve schools with 
the lowest levels of arts resources, primarily through 
forging and enhancing school-community partnerships. 
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INTRODUCTION 


School participation in the Initiative 
was voluntary, and applicants were 
required to commit to a monetary 
match earmarked for arts experi- 
ences through teaching-artist res- 
idencies, in-school professional 
artist performances, field trips, and 
afterschool programs. Demand for 
AAI participation exceeded supply in 
the first two years of implementation. 
Forty-six campuses applied to partic- 
ipate in the first year of the AAI, and 
35 additional campuses applied to 
participate in the second year. After 
consulting with our research team, 
AAI stakeholders agreed to ran- 
domly allocate participation among 
42 schools in the first two years and 
deferring AAI participation for the other applicants. In 
addition to being an impartial method for selecting AAI 
schools, this process was conducive to conducting a clus- 
ter randomized controlled trial (RCT). 


In this study, we investigate the causal effects of increases 
in elementary and middle school students’ arts education- 
al experiences, provided through school-community arts 
partnerships in the first year of program implementation. 
Comparing AAI school gains to their randomly assigned 
counterparts, we find that increasing arts learning oppor- 
tunities significantly reduces the proportion of students 
receiving disciplinary infractions, increases writing 
achievement, and increases compassion for others. We 
do not find significant effects overall on student atten- 
dance, math, reading, or science achievement, or other 
survey-based measures. For students in elementary 
schools, which were the main emphasis of the Initiative 
and comprised 86 percent of our school sample, we find 
that the intervention also improves student engagement, 
college aspirations, and arts-facilitated empathy. We also 
find that these effects varied substantially by student 
subgroups. Students receiving “limited English proficien- 
cy” (LEP) and gifted and talented (GT) program services 
appear to benefit more from these arts learning experienc- 
es. These results provide strong evidence that substantial 
increases in arts access can produce significant, multifac- 
eted educational benefits for students. 


PREVIOUS RESEARCH 


Previous Research 


he benefits of arts education are rich in theory and 

testimony but remain scant on rigorous empirical 
evidence. While existing evidence suggests that there are 
positive, significant associations between arts participa- 
tion/engagement and educational outcomes, such studies 
are typically correlational and subject to omitted variable 
bias (Elpus, 2013). In a systematic review of the literature, 
Winner et al. (2013) concluded that there is limited causal 
evidence demonstrating that the arts affect academic 
outcomes. Notable exceptions include drama education, 
which appears to strengthen verbal skills (Podlozny, 
2000), and music education, which seems to strengthen 
IQ (Moreno et al., 2011; Neville, 2008; Schellenberg, 2004) 
and improve math and reading skills (Gromko, 2005; Lee 
& Kim, 2006; Moreno et al., 2009; Standley, 2008). 


The lack of rigorous empirical evidence is attributed to 

a paucity of experimental investigations. There is also 
concern that researchers have investigated arts impacts 
with a limited set of outcomes. Arts education proponents 
contend that arts learning experiences develop student 
self-expression, creativity, and empathy (Dewey, 1919; 
Ruppert, 2006; Zimmerman, 2009), and serve as ways to 
enhance cognitive abilities which foster critical thinking 
skills (Eisner, 2002). However, researchers rarely incor- 
porate such outcomes in their investigations. A notable 
exception was an RCT evaluation of the Crystal Bridges 
Museum of American Art’s school visit program, where 
researchers collected original data and found that arts 
exposure increased student tolerance, historical em- 
pathy, and the ability to think critically about works of 

art (Bowen, Greene, & Kisida, 2014; Greene, Kisida, & 
Bowen, 2014; Kisida, Bowen, & Greene; 2016). In a recent 
review of arts integration research, this study was the 
only example of “strong evidence,” as defined by the U.S. 
Department of Education, to demonstrate causal impacts 
from school-related arts education interventions (Ludwig, 
Boyle, & Lindsay, 2017). Moreover, a series of experimental 


studies of live theater field trip performances provide evi- 
dence to suggest that these experiences increase students’ 
tolerance, social perspective taking, and command of a 
play’s plot and vocabulary (Greene, Erickson, Watson, 

& Beck, 2018). However, the Crystal Bridges and theater 
performance studies have limited external validity, as 
these interventions were confined solely to a single expe- 
rience with one arts organization’s field trip program that 
occurred over a relatively short time span. 


Lingering policy-relevant questions also remain regard- 
ing who benefits the most from receiving school-spon- 
sored arts education activities. Several studies have 
identified that race/ethnicity and socioeconomic status 
are strong predictors of access to arts and cultural 
experiences outside of school, with historically-under- 
served populations receiving substantially less exposure 
through out-of-school, family-facilitated experiences 
(Kisida, Greene, & Bowen, 2014; Meyer, Princiotta, & 
Lanahan, 2004; Redford, Burns, & Hall, 2018). Moreover, 
studies have shown that historically-underserved stu- 
dents demonstrate more-pronounced, positive impacts 
from school-sponsored arts exposure, suggesting that 
these interventions reduce gaps in educational outcomes 
tied to arts-educational activities (Catterall, Dumais, & 
Hampden-Thompson, 2012; Kinney & Forsythe, 2004; 
Kisida, Greene, & Bowen, 2014; Podlozny, 2000; Thomas, 
Singh, & Klopfenstein, 2015). Consequently, students from 
underserved communities are more dependent on schools 
to provide arts access to attain these benefits. 
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SCHOOL-COMMUNITY PARTNERSHIPS 


School-Community Partnerships 


— partnerships have become an in- 
creasingly popular strategy for addressing inequities 
in arts education (Bowen & Kisida, 2017). These partner- 
ships tend to be broad coalitions formed between school 
administrators, cultural institutions and organizations, 
policymakers, and philanthropists (Perille, 2016). No 
study to date has examined the causal impacts of these 
school-community arts partnerships, but there have been 
noteworthy non-experimental evaluations. The earliest 
evidence on these partnerships comes from investigations 
of the school-community arts partnership prototypes 
that originated in Chicago and Los Angeles in 1992 and 
1999, respectively. The Chicago Arts Partnerships in 
Education (CAPE) emphasized arts integration, where 
teaching-artists participated in elementary and high 
schools for in-depth six-week residencies. The CAPE 
evaluation team concluded that this initiative produced 

a mix of positive, though mostly null, impacts on student 
standardized test scores (Catterall & Waldorf, 1999). The 
Los Angeles Arts for All program was a ten-year endeav- 
or that emphasized the cultivation of school-community 
arts partnerships as a means for enhancing arts education 
throughout the Los Angeles Unified School District. The 
evaluation of this program 
was strictly qualitative. 
While this study did not 
address student outcomes, 
the researchers concluded 
that there were inherent 
problems in the forma- 
tion of school-community 
partnerships. They found 
that active communication, 
shared goals, buy-in, and 
adequate resources were 
essential for partnerships 
to succeed, but difficult to 


maintain. Specifically, arts organizations were often more 
interested in objectives tied to increasing student expo- 
sure to the arts and bolstering positive public relations 
through “simple transactions,” such as one-off field trip 
experiences, and less interested in providing resources 
that were tied to teachers’ educational goals, such as pro- 
fessional development sessions and experiences aligned 
with curriculum and standards (Rowe et al., 2004). 


The Chicago and Los Angeles efforts served as models 
and provided lessons for a new crop of school-commu- 
nity partnerships. In addition to Houston’s Arts Access 
Initiative, these partnerships, as well as revised or newer 
editions of preexisting partnerships, have developed in 
major metropolitan areas such as Boston (Arts Expansion 
Initiative), Chicago (Creative Schools Initiative), Dallas 
(Learning Partners), New Orleans (KID smART), and 
Seattle (Creative Advantage). While there have not been 
impact evaluations of the causal impacts of these arts 
partnership initiatives on students’ educational outcomes, 
descriptive evaluations suggest that these partnerships 
are effective mechanisms for improving student access to 
arts educational resources and experiences and address- 
ing deficits and inequities. 
Studies have found that 
these partnerships have 
successfully increased 
public school arts educa- 
tion funding (Perille, 2016; 
Silk, 2016); boosted the 
number of schools work- 
ing with community arts 
partners (Silk, 2016); and 
expanded the number of 
credit-bearing arts educa- 
tion courses available to 
students (Gibson, 2016). 
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THE AAI INTERVENTION 


The AAIl Intervention 


critical early step in the AAI was the collection of 

descriptive data on campus-level arts educational 
resources throughout HISD. These data were used to con- 
struct an inventory for assessing levels and distributions 
of arts resources and included the number of certified arts 
specialists, whether a school offered before/after-school 
arts programs, whether the campus had facilities for 
providing arts learning opportunities, and the number 
of partnerships with arts organizations over the course 
of the prior school year. Some of the key findings from 
the initial campus inventory revealed that 29 percent of 
the 209 K-8 campuses had no full-time arts specialist; 39 
percent had either one or no community arts partners;? 
and 30 percent did not provide any arts programming 
outside of regular school hours (Young Audiences, 2014). 
While a substantial proportion of HISD’s campuses were 
struggling to provide arts learning opportunities, it did 
not appear to be due to a lack of support from school 
leaders. Ninety-eight percent of surveyed principals and 
teachers agreed that “students benefit from access to the 
arts in school.” 


The findings from the campus inventory motivated AAI 
stakeholders to address gaps in campus-level arts re- 
sources, primarily through funding efforts to develop and 
enhance partnerships throughout Houston. AAI lead- 
ership recruited HISD elementary and middle schools 

to participate in the inaugural 2015-16 academic year, 
with an emphasis on serving campuses with the low- 

est levels of arts resources.? School participation in the 


2 The term “partnership” is defined here as having worked with or 
participated in an educational program with a community arts 
organization or institution. This definition broadly incorporates 
everything from a one-off field trip to in-depth, longer-term 
experiences, such as teaching-artist residencies. 


3 AAI stakeholders decided to put an initial emphasis on serving 
elementary, along with a small portion of middle schools in its early 
phases, with the intention of eventually expanding to serve more 
secondary schools. 


Initiative was voluntary, and to be considered principals 
had to commit to the mission of the Initiative, engage in 
strategic arts planning with the AAI director, designate 

a campus-level arts liaison to coordinate and facilitate 
AAT-related efforts, participate in teacher and principal 
arts-integration professional development, and attend 
AAI peer-network mentoring sessions. Participating 
schools were also required to commit a monetary match 
between $1 to $10 for AAI funding, earmarked to provide 
arts experiences through teaching-artist residencies, in- 
school professional artist performances, field trips, and 
afterschool programs.’ The AAI director and staff worked 
with principals to understand their schools’ goals for the 
upcoming year to help guide arts program selections that 
would align with their objectives. As part of this process, 
the director and staff encouraged principals to budget for 
a diversity of programs such that all of the major arts dis- 
ciplines were included: dance, music, theater, and visual 
arts.> The Houston Endowment provided a 1:1 match for 
each school’s financial commitment. Including matched 
funds, AAI schools had an average annual budget of 
$14.67 per student to facilitate and enhance partnerships 
with arts organizations and institutions. 


Using the baseline arts campus inventory, we can assess 
the impact of the AAI on the number of school-commu- 
nity arts partnerships formed as a result of the Initiative. 
In the year prior to applying to join the AAI, treatment 
and control schools were statistically equivalent in terms 
of their average number of school-community partner- 
ships. In the year prior to the Initiative, AAI treatment 


4 Afterschool programs were initially considered to be one of the 
emphasized arts educational program formats, but this requirement 
was deemphasized in the initial two years of implementation. 


5 There were also organizations and institutions that provided creative 
writing and hybrid (e.g., musical theater) programs. There were not 
enough creative writing program providers to make this discipline 
one that schools were required to include, but these programs were 
available to be included in AAI schools’ plans. 
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schools had 2.76 arts partnerships compared to 2.80 for 
the control group. Each AAI school averaged 9.86 part- 
nership-facilitated arts educational experiences over 


the school year, which represented a net increase of 5.03 
additional partnerships relative to the control group 
schools over the same period. Thirty-nine percent of these 
experiences were provided in-kind by AAI partnering 
cultural organizations and institutions. Therefore, it is 
worth noting that the aforementioned average per-student 
budget underestimates the total investment of resources 
that students received as a result of the AAI. 


The AAI director and staff worked with principals to 
understand their schools’ goals for the upcoming year to 
help guide arts program selections that would align with 
their schools’ objectives. The principal had the final say 
on their arts plan, but the AAI director and staff encour- 
aged administrators to select a diverse array of programs 
such that each of the arts disciplines and formats were 
provided at least once over the course of the year. Fifty- 
four percent of AAI student experiences were primarily 
theatre-based, 12 percent dance, 18 percent music, and 16 
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THE AAI INTERVENTION 


percent visual arts;° 31 percent of these student experienc- 
es were provided through on-campus professional artist 
performances, 27 percent were field trip experiences, 33 
percent were teaching-artist residencies, and 9 percent 
were programs provided outside of regular school hours. 


6 One AAI school participated in a creative writing program. 
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STUDY DESIGN 


Study Design 


| ie collaboration with AAI stakeholders, we devel- 
oped the following research questions to assess the 
Initiative’s impacts on student outcomes: 


= Does a substantial increase in arts education 
experiences improve student-school engagement? 


= Do these experiences increase students’ desires to 
engage and participate in the arts? 


= Do these experiences increase academic achievement 
as reflected in standardized test score growth? 


= Does the AAI affect students’ attitudes and values, 
specifically in the forms of tolerance, empathy, and 
compassion for others? 


= Are there heterogeneous effects in outcomes across 
student subgroups? 


The outcome measures for this study come from HISD 
administrative records and original student survey data. 


HISD records provided us with a dichotomous indicator 


for whether a student received a disciplinary infraction 
over the course of the school year, number of absences, 
and State of Texas Assessments of Academic Readiness 
(STAAR) standardized achievement gains in reading, 
math, science, and writing. STAAR reading and math as- 
sessments are administered to all 3rd-8th grade students. 
The writing assessment is administered to 4th and 7th 
grade students. The science test is administered to 5th and 
8th grade students. We developed our survey constructs 
using preexisting, established instruments. Additional 
survey items were developed in coordination with HISD 
and AAI program providers and stakeholders. These con- 
structs are student-school engagement, college aspiration, 
arts-facilitated empathy, compassion for others, tolerance, 
desire to participate in cultural consumption, disposition 
for arts transfer, and perceived value of the arts. Student 
survey outcomes, measures of construct reliability, item 
sources, and individual items are provided in table 1. 


With demand for AAI program participation exceeding 
supply, we were able to conduct a school-level, cluster 
RCT. Due to the limited sample size 
of 42 campuses participating in the 
AAT evaluation, school applicants 
were stratified by pairs prior to ran- 
domization, based on (in order) grade 
levels served, student demograph- 
ics, arts resources, and school-level 
achievement. This pre-randomiza- 
tion stratification strategy improves 
statistical precision when estimating 
effects with a limited number of clus- 
ters (Gerber & Green, 2012). 


fossilmike 
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DaJJHman 


Data Collection 


tudent-level administrative data were obtained 

from HISD records through the Houston Education 
Research Consortium’s (HERC) longitudinal database, 
which provides student demographics, school attendance 
and enrollment records, STAAR scores, and disciplinary 
records. We collaborated with HISD to collect original 
survey data in 2016-17, which was year one of implemen- 
tation for cohort two schools and year two of implemen- 
tation for cohort one schools. Using student identification 
codes during survey administration, survey data were 
linked to student-level administrative records. The grade 
levels for survey participation were restricted to students 
enrolled in STAAR-tested grades (3rd-8th). Moreover, at 
the request of HISD, we restricted our survey population 
to students who had not received special accommodations 
when taking the STAAR assessments. Campus testing co- 
ordinators administered a pilot survey at the beginning of 
the fall semester (late September through early October), 
and an outcome survey at the end of the school year (late 
April through May). Students’ responses on the spring 


DATA COLLECTION 


survey provide outcome measures for both of the AAI 
evaluation cohorts. We are able to use the piloted fall sur- 
vey as a measure of baseline responses with cohort two 
students as a robustness check of our findings. We could 
not use fall survey responses as a baseline with the first 
cohort because these students had already participated in 
the Initiative for a year prior to this round of survey data 
collection. Moreover, with this being the second year of 
implementation with the first cohort of AAI schools, we 
were not able to survey students who graded and trans- 
ferred out of AAI treatment and control schools after the 
2016-17 school year. 
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SAMPLE 


Sample 


he analytical sample for this study is restricted to 

4th-8th grade students with baseline standardized 
math and reading test scores. We control for baseline test- 
score achievement throughout our analyses; therefore, 
students enrolled in 3rd grade and below are not included 
in these analyses. There were 10,548 students enrolled in 
AAI treatment and control schools over the evaluation 
period. There were 1,934 first cohort students who graded 
and transferred from their AAI evaluation schools. Of the 
8,614 AAI evaluation students enrolled in AAI treatment 
and control schools the year of the survey, we collected 
and linked survey to administrative data for 6,340 (74 per- 
cent) students. Of the 6,500 second cohort AAI evaluation 
students, we collected and linked 4,901 (75 percent) spring 
surveys to administrative records; of these second cohort 
spring survey participants, we were able to link 3,708 (76 
percent) of their spring responses to the pilot fall survey 
(or 57 percent of the second cohort of students). Thirty-six 
of 42 schools served students at the elementary level, with 
students in grades PK-5, and six were middle schools 
with students in grades 6-8. Student demographics, as 
well as baseline measures of achievement, attendance, 
and discipline are provided in table 2. 


AAI treatment and control school students were statisti- 
cally equivalent in terms of baseline grade level, gender, 
free- and reduced-price lunch (FRL) eligibility and higher 
poverty status, race/ethnicity, proportion of students re- 
ceiving special education services, proportion of students 
receiving LEP program services, math achievement, and 
the proportion of students who had received a disci- 
plinary infraction the prior academic year. However, there 
was a statistically significant difference in average base- 
line reading achievement. AAI treatment students had 
higher STAAR reading test scores than control students 
in the year prior to participating in the AAI. While this 
baseline imbalance calls into question the integrity of the 
randomization process, the fact that there is one signifi- 


cant difference across fifteen baseline characteristics can 
be attributable to a chance outcome due to random as- 
signment. In our analyses, we control for baseline reading 
achievement, along with the other specified demographic 
covariates, to improve precision and strengthen our abili- 
ty to generate unbiased estimates of the treatment on our 
outcomes of interest (Gerber & Green, 2012). 


Comparing targeted student participants to nonpartici- 
pants shows the extent to which survey respondents are 
representative of the targeted population. Survey partic- 
ipants, relative to the targeted survey population, were 
significantly more likely to be female and white, less likely 
to have received a disciplinary infraction in the prior 
academic year, had fewer absences, were less likely to be 
receiving special education services (due to the restriction 
of not surveying students who receive accommodations 
for STAAR testing), and were higher achieving in terms of 
standardized baseline STAAR reading and math scores. 
However, when we compare the survey participants by 
treatment and control status, the only observable statis- 
tically significant difference is baseline reading achieve- 
ment, and this difference is not statistically significantly 
different from that of the broader sample (p = 0.67). Survey 
participant demographics, by survey participation and 
treatment status, are available in the appendices. 
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Analysis 


he experimental design of this evaluation provides a 
straightforward analytical strategy. We estimate the 


AAT intent-to-treat (ITT) effects with the following model: 


Yim = A+ AALY, + Match y, + Xy,+¢,,. () 


1S 


Where Y signifies an outcome of interest for student, 

i, enrolled in school-grade, s, matched pair, m. AAI isa 
dichotomous variable that indicates whether the student 
was enrolled in a school that was randomly assigned 

to participate in the AAI; Match is a vector of dummy 
variables for the pre-randomization matched pairs; X is 
a vector of student demographics, specifically student 
grade level, gender, race/ethnicity, FRL eligibility/pover- 
ty status, a dichotomous indicator for receipt of special 
education services, LEP status, prior year absences, an 
indicator for whether the student received a disciplinary 
infraction the previous school year, and prior year’s 
STAAR math and reading scores; ¢ is the error term 
clustered at the school-grade level. We have also estimat- 
ed local average treatment effects with a two-staged least 
squares regression, where the AAI lottery serves as an 
instrument to predict the percentage of a student’s school 
year spent in an AAI school to then estimate the impact 
of being enrolled for an entire academic year. First stage 
estimates, depending on outcome measure, range from 
0.961 to 0.987, meaning that local average treatment effects 
were only slightly larger in magnitude than the ITT esti- 
mates. Moreover, none of the local average treatment ef- 
fects were substantially different than the ITT estimates; 
these results are provided in the appendices. 


We also investigate student-level treatment effect modera- 
tors. With such a diverse student population, we examine 
whether the AAI treatment produces effects that vary 

by subgroups that have been historically correlated with 
differences in educational outcomes. Studies have found 
that effects with arts education interventions tend to be 
more pronounced with students from historically-under- 
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served communities and subgroups (Catterall, et al., 2012; 
Kisida et al., 2014; Podlozny, 2000). Therefore, we test 

the hypothesis that students who likely have less access 
to arts learning opportunities will experience greater 
treatment impacts. To investigate this possibility, we run 
separate analyses restricted by school-grade levels served 
(i.e., elementary and middle), gender, race/ethnicity, FRL 
and higher poverty status, LEP status, and GT status. 


RESULTS 


Results 


R= by outcome, for the overall as well as sub- 
group samples, are provided in tables 3 and 4. We 
find three statistically significant positive results for the 
full sample. Increasing students’ arts educational expe- 
riences reduces the proportion of students receiving a 
disciplinary infraction by 3.6 percentage points; increases 
writing achievement by 0.13 of a standard deviation; and 
increases students’ compassion for others by 0.08 of a 
standard deviation. Estimates are typically in the positive 
direction for all other outcomes, but fail to achieve tradi- 
tional levels of statistical significance. 


We examine moderating effects by investigating student 
subgroup impacts. We find numerous positive impacts, 
particularly on survey measures, with elementary level, 
LEP, and GT student subgroups. In addition to these 


subgroups exhibiting more-pronounced effects on writing 
achievement and compassion for others, these students 
demonstrate positive treatment effects on school en- 
gagement, college aspirations, arts-facilitated empathy, 
disposition for arts transfer, and perceived value of the 
arts. Positive effects on school engagement are particular- 
ly noteworthy, as it is the most common positive subgroup 
finding that was not significant for the overall sample. 
There is also some evidence to suggest negative impacts 
with middle school students in terms of school engage- 
ment and college aspiration. 
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ROBUSTNESS CHECKS WITH SURVEY DATA 


Robustness Checks 
with Survey Data 


he availability of survey baseline measures for 

students in the second cohort allows us to estimate 
first-year impacts in terms of growth, albeit with a smaller 
sample of only cohort two students. Nevertheless, this 
approach serves as a strong robustness check of our esti- 
mates. The compassion for others outcome remains posi- 
tive in this analysis, and it is worth noting that this impact 
increases by roughly 40 percent, suggesting that these 
effects may be primarily attributable to impacts that occur 
in the first year of implementation. This analysis also re- 
veals an overall statistically significant, 0.16 of a standard 
deviation increase in school engagement and a 5.7 percent- 
age point increase in students’ college aspirations. 


Survey outcome measures were constructed such that 
items were standardized and equally weighted. This 
approach potentially over-weights item responses that 
are not as strongly correlated to the other items in the 
construction of the outcome measure. Therefore, we have 
also examined the sensitivity of our survey results by 
conducting an analysis where the outcome measures were 
reconstructed based on factor loadings. This alternative 
construction of the outcome measures has no impact on 
the qualitative interpretations of the treatment effect es- 
timates. The comprehensive factor analysis estimates, by 
outcomes and subgroups, are provided in the appendices. 


There also remains the possibility that nonresponse bias 
could have influenced survey-derived effect estimates. 
Students in the control group had a significantly higher 
response rate (9 percentage points) than those in the treat- 
ment group. Results from our primary analysis rely on 
the assumption that survey responses are missing at ran- 
dom and, therefore, not biasing our treatment effect esti- 
mates. Relative to the main analytical sample, we do not 
observe significant differences in surveyed treatment and 
control group students. While we cannot entirely dismiss 
concerns of nonresponse bias, we further investigate the 
sensitivity of these results by conducting an inverse-prob- 
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ability-weighted regression adjustment (IPWRA) and 
bounding our treatment effect estimates, such that, on 
average, we trim 9 percent of the control group survey re- 
sponses to estimate the bounds of the treatment effect for 
those students who would have been surveyed regardless 
of treatment status (see Lee, 2009). Rather than trimming 
the top and bottom 9 percent of control students, we 
determined trimmed proportions by response rate dispar- 
ities within, rather than across the matched pairs. We find 
that our compassion for others outcome remains positive 
and statistically significant across specifications with the 
exception of the lower Lee bounds, which remains in the 
positive direction but fails to achieve statistical signifi- 
cance. The school engagement outcome is positive for the 
IPWRA and upper bound specifications, but null with 
the lower bound specifications. The results from these 
robustness checks are provided in Table 5. 


DISCUSSION & CONCLUSION 


Discussion & Conclusion 


Oo: investigation is the first large-scale randomized 
control trial of an arts education program imple- 
mented in an authentic educational setting. This program 
was implemented in a diverse array of elementary and 
middle schools in the nation’s 7th largest school district. 
We find that increases in students’ arts learning expe- 
riences significantly improve educational outcomes. 
Fostering and supporting these experiences lead to 
improvements in student discipline, writing achievement, 
and compassion for others. These results are robust 

and support hypotheses and prior findings that the arts 
can play a critical role in positively affecting meaningful 
educational outcomes (Catterall et al., 2012; Deasy, 2002; 
DiMaggio, 1982; Fiske, 1999; Ruppert, 2006). 


In general, the STAAR writing test assesses students’ 
knowledge of mechanics through two components— 
multiple choice items and composition skills through an 
open-response expository essay. When we disaggregate 
this assessment to examine whether overall writing score 
gains are disproportionately driven by increases in stu- 
dents’ mechanical or written composition achievement, 
we find that the AAI significantly increases student 
scores on both sections, but effects were greater in mag- 
nitude with written composition. Specifically, scores on 
the writing mechanics section increased by 0.08 of a stan- 
dard deviation (p = 0.03), and scores on the expository 
essay increased by 0.18 of a standard deviation (p < 0.01). 
This increase in writing achievement, particularly with 
expository writing composition, is especially noteworthy 
in that there is limited rigorous evidence for transfer in 
terms of arts educational interventions bolstering out- 
comes typically tied to other school subject areas (Winner 
et al., 2013). The benefits of arts education with writing 
achievement potentially corroborates and further in- 
forms past research showing the benefits of the arts with 
regard to critical thinking, as assessed through students’ 
written responses and interpretations of original works 


of art after an in-depth art museum-facilitated lesson 
(Bowen et al., 2014). 


The main findings from this study were generally robust 
across student subgroups; however, there were nota- 

ble variations in subgroup outcomes that could inform 
policy decisions and future research efforts. We find that 
reductions in disciplinary infractions appear to be more 
pronounced with middle school-level, male, African- 
American, non-FRL, and higher poverty-household 
students. Recent studies have shown that, with the excep- 
tion of non-F RL, these students disproportionately incur 
disciplinary infractions (Anderson & Ritter, 2017; Skiba et 
al., 2014). Variations in subgroup outcomes are potentially 
attributable to ceiling effects with groups that have been 
less likely to incur disciplinary infractions. This consid- 
eration appears to be relevant to our sample. Ten percent 
of the students in our sample had received a disciplinary 
infraction the previous year; however, these infractions 
were disproportionately more likely to be incurred by 
males, middle schoolers, higher poverty students, and 
African-American students. 


We also find that some outcomes are more likely to be 
statistically significant and positive, as well as larger in 
magnitude for elementary-level students. In addition to 
these subgroups exhibiting more-pronounced effects on 
writing achievement and compassion for others, these 
students demonstrate positive treatment effects on school 
engagement, college aspirations, and arts-facilitated 
empathy. The AAI disproportionately served elementary 
schools in its first two years, comprising 86 percent of our 
sample. Program delivery at this school level was the pri- 
mary focus at this stage of the Initiative, and it is likely the 
disproportionate attention given to serving these schools 
may have better ensured fidelity of implementation. On 
the other hand, the effects unique to middle school stu- 
dents should be interpreted with caution. There were only 
six middle schools in this study, a circumstance which 
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lends itself to spurious results (Button et al., 2013). Finally, 
it is important to take into consideration that educational 
interventions typically have greater effects with young- 

er students (Heckman, 2006), meaning that even witha 
larger middle school sample, we might not expect effects 
of the same magnitude. 


Positive effects were also more pronounced with LEP 
and GT students. LEP and GT students demonstrated 
numerous positive effects on survey constructs, including 
school engagement, arts-facilitated empathy, arts transfer 
disposition, and valuing art. LEP students additionally 
showed positive effects on college aspirations and desire 
to consume arts. GT students had an additional posi- 

tive effect on tolerance. A possible explanation for the 
strong, positive effects with LEP and GT students is that 
test-based accountability pressures have yielded circum- 
stances that have withered the scope of K-12 educational 
opportunities. The majority of schools participating in the 
AAT had recently experienced pressure with test-based 
accountability sanctions. These sanctions tend to narrow 
educational offerings while intensifying the emphasis on 
student standardized test achievement, especially with 
those students scoring near critical accountability thresh- 
olds (Booher-Jennings, 2005; Deming, Cohodes, Jennings, 
& Jencks, 2016; Neal, 2010; Neal & Schanzenbach, 2010; 
West, 2007). The reinjection of the arts in these schools 
likely expanded enriching offerings and opportunities 
that plausibly improve student engagement, particularly 
with LEP and GT students who were more likely to have 
been adversely affected by school responses to account- 
ability pressures. 


There are a few limitations to this study. While random 
assignment to the AAI treatment allows us to confidently 
infer a causal relationship between the treatment and as- 
sessed outcomes, we remain less certain about the extent 
to which these results would be achieved in other con- 
texts. In order to participate in the AAI, principals had to 
have the commitment and desire to improve their schools’ 
arts educational offerings. Our research design ensures 
that this commitment and desire is balanced across the 
treatment and control groups. However, such results may 
not be achievable with schools that lack leaders who are 
as dedicated to providing and supporting the arts on their 
campuses. Another context-specific consideration is that 
Houston is a very arts-rich metropolis with a wealth of cul- 
tural institutions and organizations strongly committed to 
partnering with schools in the community. Smaller or less- 
arts-rich cities, as well as suburban and rural communities, 
may lack the resources necessary for providing effective 
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school-community arts partnerships. However, it is worth 
nothing that there are widespread instances of school-com- 
munity partnerships with arts organizations across com- 
munities of various sizes (Bowen & Kisida, 2017). 


Another limitation is that, when defining the treatment 
for this study, we are restricted to the provision of match- 
ing funds and other AAI supports that foster, facilitate, 
and deliver school-community arts partnerships. We can 
state with confidence that our findings are a result of in- 
creasing arts educational experiences through these part- 
nerships. However, we do not know whether (and which) 
particular mediators were responsible for these outcomes. 
The arts educational experiences that students received 
were incredibly diverse in terms of program format and 
arts discipline. The AAI director and staff worked with 
principals to develop plans and program selections that 
would align with the goals they had for their schools, 
which typically resulted in students receiving dance, 
music, theatre, and visual arts educational experiences 
through each of the various program formats: field trips, 
in-school professional artist performances, teaching-art- 
ist residencies, and programs that took place outside of 
regular school hours. Due to the variation and endogene- 
ity in program selection across schools, we do not know 
which particular types of offerings were more likely to 
bring about desired effects. Finally, these analyses are 
restricted to shorter-term outcomes, and it remains to be 
seen if these effects will ultimately compound, serve as a 
one-time boost, or diminish over time. Critical next steps 
in this field of study will be to examine whether particular 
formats and varieties of arts educational programs are 
more successful in generating desired effects over longer 
periods of time. 


The results of this study provide critical evidence that 
increasing students’ arts educational opportunities has 
positive impacts on meaningful outcomes. The narrow- 
ing of educational offerings and objectives to align with 
accountability assessments has had adverse effects on the 
arts in K-12 education. Despite the logic behind narrow- 
ing educational offerings, substantial influxes of arts 
educational experiences do not appear to be detrimental 
to student growth in outcomes tied to accountability 
assessments. However, we do find evidence that these 
reductions pose significant costs. Arts learning experi- 
ences benefit students in terms of social, emotional, and 
academic outcomes. Education policymakers should be 
mindful and considerate of these benefits when assessing 
the opportunity costs that come with decisions pertaining 
to the provision of the arts in schools. 
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TABLE 1 


Table 1 


Survey Outcomes 
Outcome Items Source(s) Cronbach’s Alpha 
®™ School work is interesting. 
™ School work makes me think about things in new ways. Tripod Student 
School = School work is not very enjoyable. Perceptions; 0.73 
Engagement ™ This school is a happy place for me to be. Austin ISD 
= This school offers lots of different types of programs, classes, Climate Survey 
and activities to keep me interested in school. 
College : Austin ISD 
Aspiration HORM) ele Noe Climate Survey Me 
= Works of art, like paintings, music, dance performances, and plays, 
- help me understand what life was like in another time or place. — 
Arts-Facilitated : : Greene, Kisida, & 
®™ | can learn about my classmates by listening to them talk about 0.67 
Empathy Bowen (2014) 
works of art. 
™ Works of art help me imagine what life is like for someone else. 
Compassion for = | want to help people who get treated badly. Greene, Kisida, & 0.47 
Others = | am not really interested in how other people feel. Bowen (2014) 
™ | think people can have different opinions about the same thing. ve 
: f : ; : Greene, Kisida, & 
Tolerance appreciate hearing views different from my own. 0.38 
: ; ; i Bowen (2014) 
™ People who disagree with my point of view bother me. 
= | plan to go to art museums and galleries when | am an adult. 
a an to go to the theater for plays, musicals, and performances ee 
Cultural = g ee x Greene, Kisida, & 
: when | am an adult. 0.73 
Consumption ; Bowen (2014) 
® | plan to go to music concerts when | am an adult. 
= | plan to go to dance performances when | am an adult. 
= The arts can help me be a better student. NAEA-AAMD Art 
Arts Transfer ™ Things | have learned in school can help me understand the arts. ene ee 0.78 
Disposition ® Learning about the arts can help me understand things | learn in Survey 
school. 
= The arts art interesting to me. 
= The arts are an important part of my life. 
® | enjoy talking about the arts. NAEA-AAMD Art 
Value the Arts ® | think artists do important work. Museum Impact 0.85 
H Artis one of my favorite subjects in school. Survey 
™ | would like to take more classes in the arts when | get to high schoo! 
and college. 


Note: Due to there being only two items that comprised Compassion for Others and low internal consistency with Tolerance, we have analyzed these 
items, individually, that were used to form this construct. We have run results with these outcomes both as a single construct and by examining each of 
the survey items that comprise the construct individually. We primarily report analyses with these outcomes as single constructs; however, we note any 
instances in the ITT overall and subgroup analyses where individual items produce results that substantially deviate from those of their constructs. 
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TABLE 2 


Table 2 


Descriptive Statistics by Treatment Status 


Variable Treatment Loreyalige)| Difference 
5.594 540i -0.107 
Credo ve (0.287) (0.274) (0.396) 
Female 0.486 0.489 -0.003 
(0.006) (0.008) (0.010) 
FRL Status: 
0.136 0.134 0.002 
NONE E (0.023) (0.020) (0.031) 
er 0.301 0.289 0.013 
Free Lunch Eligible (0.017) (0.021) (0.027) 
Reduced Lunch Eligible igen oe cae 
0.489 0.508 -0.019 
Ow (0.030) (0.022) (0.037) 
Race/Ethnicity: 
African-American eS Cae ee 
(0.043) (0.045) (0.062) 
Hispanic/Latinx Ou oe IG 
(0.046) (0.044) (0.064) 
: 0.027 0.029 -0.003 
te (0.010) (0.012) (0.015) 
. , me 0.060 0.068 -0.008 
Special Education (SPED) (0.008) (0.009) (0.009) 
Limited English Proficiency (LEP) es aon cou 
Baseline Reading (standardized) er ane ree 
Baseline Math (standardized) oa i aon ee 
Prior Year Disciplinary Infraction cana ie oon ie ae 
Baseline Absences #08 oe pees 
(0.318) (0.397) (0.507) 
Sample Size Bc SkSks) Ao) 10,548 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
When “baseline” is specified for time-sensitive academic achievement, it is for 2014-15 for the first cohort and 2015-16 for the second cohort. Test 
scores standardized relative to the rest of HISD with a mean of zero and standard deviation of one. 
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TABLE 3 


Table 3 


Administrative Data-Derived Outcomes by Subgroup 


Population N Discipline Absences Math Reading Science Writing 
Overl 4068-10548 | 6.945) 0128 0.069) (0018) (0.065 (0.046) 
Elementary 2,547-5,565 . ae hs a ae nes oon (6.065) 
Middle 1,516-4,983 ive re oe fad oF eon & Gas 
Female 2009-6140 | Go (0149 0.070) (0.022 (0067 (0.087) 
ee ae ee ee ee 
re aso-2s0a | “o.oo ae ae fee need ores 
Hisp-Latx 2856-7488 | o%g orn 0078) (0.029 073 (0.087 
Not FAL 6021421 | “To.gpa) (0.221 (0.082) (0.044 (0135) 116 
ra ee ee eee ee ee 
en Ee ee ee ee 
= ae oe ne ne ae 
ar 791-1927 (ot0) 0149 0.166) (0.035 0.180) (0.094 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
Test scores are standardized with a mean of zero and a standard deviation of one. 
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TABLE 4 


Table 4 


Survey Data-Derived Outcomes by Subgroup 


Lie) oL¥1-14(0) 3) Pesaran Freee Arts Empathy | Compassion Tolerance Beeianice ge atin Values Art 
Se Ee ee ee 
Elementary | 3619-3660 | feos | yo.o2) | (0.047 | 03) | O01 | 05 | oa |  (@088 
Middle | 2628-2665] onan | oor | oa) | os | @064 | oa) | os | @.064 
Female | 9182-8185 | e058 | (cag | oe | oa) | oa | oa | cosy |  @oa9 
Male 9092-3140 | Gos | oes) | 00a | 0a) | oa | oo | cosy | 086 
Atcamer, | 1444-1472 | @o7) | (0023) | os) | oa) | os | (00s | 069 | (066 
Hisp-Lats, | 4939-4986] Goce) | ooo | (aos) | (o0as | o.0a9 | oa | oes | 0.039 
NotFRL | 840-848 | ors) | (00s) | 114 | (o0ss | cosy | om | ora | org 
FAL 2245-2281 | os) | 0.028) | oa | aoa | oa | ooay | aoa | 0088) 
Poverty | 8058-8098 | Gos) | oor | oa | cos | oor | 04 | (os) | oar 
a 1970-1993 | (ora) | o.02 | (0.058 | (0.086) | ooa | (006s) | (o.oo | (0.057 
CT 4.265-1,281 0.158* 0.042 0.201** 0.232** 0.136** 0.092 0.176** 0.232** 
: : (0.073) (0.027) (0.069) (0.046) (0.051) (0.056) (0.065) (0.074) 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
When investigating individual items for Compassion for Others and Tolerance, there are some qualitative differences in the interpretations of 
individual survey item effects relative to those for the constructed outcomes. For the Compassion item “I want to help people who get treated badly,” 
there is a significant positive effect with females (p = 0.03) and FRL-eligible students (p = 0.03), and a lack of a significant effect with males 

(p = 0.08). For the Compassion item “I am not really interested in how other people feel,” there is a lack of a significant effect with the overall sample 
(p = 0.09) and Hispanic/Latinx students (p = 0.09). For the Tolerance item “I think people can have different opinions about the same thing,” there is 
a significant negative effect with African-Americans (p = 0.01). For the Tolerance item “I appreciate hearing views different from my own,” there isa 
significant positive effect with LEP students (p = 0.03). For the Tolerance item “People who disagree with my point of view bother me,” there is a lack 
of a significant effect with GT students (p = 0.12). 
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TABLE 5 


Table 5 


Robustness Checks for Survey Outcomes 


Lee Bounds 


Pre-Post Factor 

Outcome Cohort 2 Analysis IPWRA ATE —a 
eee Rae 0.093 0.095 0.155** 0.080 0.074** | 0.164* 0.045 
gag ; (0.052) (0.051) (0.048) (0.043) (0.025) | (0.055) (0.073) 
= 0.015 0.015 0.057* 0.010 0.080** -0.035 
Ces eSpreten a (0.018) (0.018) (0.023) MS (0.012) (0.029) (0.032) 
- 0.039 0.089 0.051 0.029 0.024 0.118" -0.020 
CS CSIUEMSCH ENN OSIM. | sez (0.036) (0.036) (0.047) (0.028) (0.027) (0.046) (0.066) 
0.080* 0.081* 0.113** 0.047* 0.071* | 0.183" 0.033 
Pompas loi Ones ee (0.032) (0.033) (0.036) (0.019) (0.026) (0.050) (0.056) 
ee ae -0.004 -0.004 0.006 -0.001 -0.016 0.057 -0.060 
(0.036 (0.036) (0.043) (0.021) (0.026) (0.047) (0.064) 
Sica mae ee 0.030 0.080 0.031 0.022 0.030 0.086 -0.035 
(0.036 (0.036) (0.047) (0.030) (0.025) (0.050) (0.062) 
ee 0.054 0.055 0.042 0.044 0.040 0.133** -0.011 
ES Meelis tes IS ae Siren Oz (0.038 (0.038) (0.051) (0.032) (0.027) (0.042) (0.072) 
0.060 0.061 0.016 0.036 0.035 0.129** 0.003 
tae tle ee 6,285 (0.043 (0.043) (0.045) (0.028) (0.027) (0.043) (0.073) 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
Pre-post analyses are for cohort two students only; this restriction reduces the sample sizes to a range of 3,511 to 3,625 observations. Lee Bounds 
“snip” the upper and lower tails of the dependent variable of interest distribution with the control group, which had a higher response rate than 
the treatment group; the upper and lower bound snips reduced the sample sizes to a range of 5,381 to 5,700 observations. College aspiration is not 
included because results are based on a single survey item. 
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Appendices 


Survey Participant Demographics and Treatment-Control Comparisons 


APPENDICES 


WETa tele) (<3 PERteeR ts poatietca Baers Survey Treat Survey Control T-C Difference 
eradeteacal 5.674 5.958 -0.284 5.693 5.656 0.037 
(0.232) (0.253) (0.184) (0.346) (0.314) (0.466) 
arcs 0.504 0.476 0.027* 0.502 0.505 -0.003 
(0.007) (0.011) (0.014) (0.010) (0.011) (0.015) 
FRL Status: 
Not FRL 0.184 0.182 0.002 0.1389 0.130 0.009 
(0.021) (0.017) (0.018) (0.034) (0.026) (0.043) 
Freatuneh 0.302 0.290 0.012 0.305 0.299 0.007 
(0.017) (0.020) (0.014) (0.024) (0.024) (0.034) 
Beene cere 0.074 0.068 0.006 0.076 0.073 0.004 
(0.006) (0.008) (0.006) (0.008) (0.008) (0.011) 
Barer 0.490 0.509 -0.019 0.480 0.499 -0.019 
y (0.022) (0.022) (0.016) (0.035) (0.026) (0.044) 
Race/Ethnicity: 
Rare AGeriCon 0.283 09255 -0.022 0.244 0.222 0.022 
(0.032) (0.047) (0.037) (0.052) (0.039) (0.065) 
Hispanie/ atin 0.694 0.709 -0.015 0.679 0.707 -0.029 
P (0.034) (0.048) (0.039) (0.058) (0.039) (0.070) 
White 0.034 0.017 0.018* 0.032 0.037 -0.005 
(0.011) (0.004) (0.009) (0.016) (0.016) (0.023) 
SPED 0.048 0.097 -0.049** 0.045 0.050 -0.006 
(0.004) (0.010) (0.010) (0.006) (0.005) (0.008) 
LEP 0.315 0.318 -0.003 0.311 0.319 -0.007 
% (0.029) (0.038) (0.037) (0.047) (0.035) (0.058) 
: ; 0.046 -0.151 0.197** 0.157 -0.055 0.212* 
Bes lhe Resclag (0.051) (0.072) (0.067) (0.085) (0.048) (0.097) 
Beecinoniatn 0.068 -0.122 0.190** 0.140 0.002 0.138 
(0.054) (0.061) (0.058) (0.087) (0.062) (0.106) 
Baseline kbsenees 4.289 esi -2.344** 4.705 5.207 -0.502 
(0.200) (0.571) (0.421) (0.368) (0.363) (0.514) 
BaecinaDiecisiine 0.069 0.122 -0.052* 0.062 0.075 -0.013 
p (0.014) (0.027) (0.020) (0.020) (0.019) (0.027) 
Sample Size 6,340 8,437 8,437 | 3,026 3,314 6,340 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors adjusted for school-grade clustering. Survey 
participation column is for the spring administration and is relative to the targeted survey population. When “baseline” is specified for time-sensitive 


academic achievement, it is for 2014-15 for the first cohort and 2015-16 for the second cohort. Test scores standardized relative to the rest of HISD with 


a mean of zero and standard deviation of one. 
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First Year Administrative and Survey Results—ITT and ATE 


Outcome 


1st Stage 
(s.e.) 


2SLS 
(s.e.) 


Disciplinary Infraction 10,548 nie) inca (0.015) 
Absences 10,548 ee eel ae5 
Math (4-8) 10,130 (0.089) (0.002) Gee) 
Reading (4*-8'") 10,140 ie na 10008) (0.020) 
Science (5"" and 8") 4,063 i ae i aen nes 


Wiring (@h and 7 4952 | 04s) | (0.003) | (0.046) 
School Engagement 6,325 ee aes oa 
College Aspiration 6,311 can nee ae 
Arts-Facilitated Empathy 6,249 Gon ae Goss 
Compassion for Others 6,290 ee nee hae 
Tolerance 6,299 036 | (0002) | 0.036) 
Cultural Learing 6.16 0s | (0002 | _(o089 
Cultural Consumption 6,241 Gee en eee 
Arts Transfer Disposition 6,259 ace eon eee 
Value the Arts 6,286 cow | (o.002) | 004g 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05. Standard errors are in parentheses and have been clustered at the 


school-grade level. Test scores are standardized with a mean of zero and a standard deviation of one. 
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Local Average Treatment Effects for Administrative Data-Derived Outcomes 


Lede) oLULE-LiCeya} | | Discipline | Absences | Math | Reading | Science | Writing 
Overall | 4063-10648] Toots) | ors | @.0s | 02 | (oss) | (0.046) 
Elementary | 2647-5565 | oor) | rai) | 04s | (008) | (0.050 _| (0.065) 
Middle | 1816-4983 | Toga) | 2) | 120) | (oz) | 12 | (aoa 
Female | 2009-5140 | oor | ora) | oor | (022 | @0s8) | (0.087 
Mal 2054-5408 | “o.o20) | oie | (00s | 002) | (0066) | (0.080) 
At-amer, | 950-2608 | “oore | (ose) | 004) | 0.039 | 05 | (0.084 
Hisp-Latx, | 2.856-7496 | ‘eot) | 161 | oor) | 02 | ory | (0.087 
NotFRL | 802-1421 | ooo) | (0.225) | (0.082) | (0044 | (Otay | (oat) 
FRL 1485-9875 | eota | or | 08 | oe | ory | (0.087 
Poverty | 1975-5255 | ‘eot) | core) | 0a | (0026) | (0050) | (0.049) 
a ee we ee ee a 
Sa ec 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
Test scores are standardized with a mean of zero and a standard deviation of one. 


Local Average Treatment Effects for Survey Data-Derived Outcomes 


Population Eee Pin ae Arts Empathy | Compassion Tolerance Corea foeuaar Values Art 
[oe een ee eee 
So een a ae ee 
oe eee eee 
|e en ee en ees 
oe ae ee 
Aicamer, | 1444-1472 | 060) | (ooze) | ose) | oom) | (o0se) | 0088) | (069 | (0086) 
Hisp-Lave | 4989-4986] Gos) | (0.022) | (o0se) | (o0as | 04 | (aoa | oes) | (039 
NotrAL | e40-848 | ory | os | ory | oe | oon | or | 10g | ong 
FRL 2245-2281 | os) | 028) | oa | 04) | oa) | oa | (0s | 088) 
ee ee a ee ee ee 
a 1970-1993 | oor) | o.02 | (0.058 | (0.086) | (aos) | (0.066 | 0.06 | (0.057) 
CT 4,265-1,281 0.160* 0.043 0.204** 0.236** 0.138** 0.094 0.179** 0.235** 

' , (0.073) (0.027) (0.069) (0.046) (0.050) (0.055) (0.065) (0.073) 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
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Survey-Derived Outcomes with Factor Analysis 


Population pence! eS Compassion Tolerance ole AE Wo 
Engagement Empathy Consumption Disposition 
Overall 6122-6311 | oa | 028) | oor) =| oe) | 00 (0.032) 0.028 
Elementary | 9,640-3652 | ‘¢.94@) | (0.037) | 0.02) | 02 | (042 0.010 | (0.036 
Mia 2eze-2665 | ‘eos | oos | 02 | os) | (0.036) 0.048) 0.041 
Female | 9096-8182 | gga | (0.034 ©o2 | 002 | (00s 0.044) 0088 
Male 9026-2:129 | G04 | os | (oor | (002 | (aos 0.038 0.028 
Ai-amer. | 1408-1469 | Gos | oa | (oooy | 0039 |  Oo48 0.088 0.089 
Hisp-Latx | 4254-4877 ] Goa | oan | o.028 | 02 | (086 0.080 0.023 
Not FRL 802-845 | oe) | coos) | o0s7) | os | ort 0.086 0.079 
FAL BoP eee) (0.050) 0.04 (0.085) 0027 (087 0.040 0.084 
Poverty | 2988-3092 | G4 | (0.030) | (0.022) 0.026 | (0084 0.038 (027 
LEP 1925-1989 | ‘oo6) | (ooasy | os | O03 | (0084 | (os | (0.036) 
Gr 1280-1280 | 09 | o0s4 | (0.026) | (0.02) | (aos) | (0.085) | (0.082) 


Note: ** statistically significant (two-tailed) at p < 0.01; * significant at p < 0.05; standard errors in parentheses adjusted for school-grade clustering. 
College aspiration is not included because results are based on a single survey item. 
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